Skip to content

arrow-avro: Deprecate object_store integration - #10484

Merged
alamb merged 1 commit into
apache:mainfrom
polarsignals:rm-obj-store-avro
Jul 31, 2026
Merged

arrow-avro: Deprecate object_store integration#10484
alamb merged 1 commit into
apache:mainfrom
polarsignals:rm-obj-store-avro

Conversation

@brancz

@brancz brancz commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Deprecate AvroObjectReader in favor of implementing AsyncFileReader directly (see the example on the trait docs and
arrow-avro/examples/object_store.rs). To reduce the code needed by implementors I also added SpawnedReader. Still keeping object_store as a dev-dependency so we can ensure compatibility and use it in testing.

Which issue does this PR close?

Rationale for this change

See the issue

What changes are included in this PR?

Decoupling and removal of object_store dependencies in arrow-avro.

Are these changes tested?

Yes, see unit tests

Are there any user-facing changes?

No, but deprecation warnings that there will be.

@alamb

Deprecate AvroObjectReader in favor of implementing AsyncFileReader
directly (see the example on the trait docs and
arrow-avro/examples/object_store.rs). To reduce the code needed by
implementors I also added SpawnedReader. Still keeping object_store as
a dev-dependency so we can ensure compatibility and use it in testing.

@alamb alamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @brancz -- this looks good to me and consistent with the parquet deprecation

@alamb
alamb merged commit fd8ead5 into apache:main Jul 31, 2026
30 checks passed
@alamb

alamb commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

I also filed a follow on PR here to add some more links to the docs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

arrow Changes to the arrow crate arrow-avro arrow-avro crate enhancement Any new improvement worthy of a entry in the changelog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants